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The  contract  covered  by  this  annual  report  includes  a variety  of  activities  and  services  centering 
around  the  continued  growth  and  well-being  of  inh  ri  isp,  a large,  interactive  system  widely  used 
in  the  arpa  community  for  developing  advanced  and  sophisticated  computer-based  systems. 
Perhaps  the  best  wa>  to  .eport  on  the  progress  accomplished  over  the  period  of  this  contract  is  to 
present  these  activities  in  terms  of  the  original  work  statement: 


Statement__of_Work 

a)  Maintenance  of  the  user  portion  of  intf.rusp  --  finding  and  fixing  bugs  reported  by 
the  arpa  community,  and  modifying  or  improving  existing  features. 

b)  Documentation  --  producing  and  maintaining  documentation  for  intf.RMSP,  including 
an  on-line  INTFRUSP  reference  manual,  and  programs  for  convenient  accessing  of  this 
manual,  i.e.  an  information  retrieval  facility. 

c)  Distribution  of  new  intfri  ISP  systems  --  periodically  bringing  up  and  checking  out 
new  releases  of  the  system,  and  distributing  them  to  selected  arpa  sites. 

d)  Coordination  and  user  interaction  --  insuring  th?i  the  various  csers  communities  arc 
kept  informed  of  developments  in  imfrusp.  and  that  they  have  the  opportunity  iO 
participate  in  and  influence  such  developments.  Also,  insuring  that  new*  implementations 
of  in  i i k i isp  conform  to  INTFRUSP  standards. 
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During  the  contract  year,  we  received  and  responded  to  a host  of  reports  of  hugs,  non-features, 
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UTAH  - 10.  RUlcil  US-10,  MIT-MC,  oMKT-l  The  following  examples  are  typical  of  the  r;  nge  of 
these  interactions: 

A user  at  isi  (Goldman)  reported  a bug  in  the  translation  cf  iterative  statements  win  :h  was 
corrected. 

A user  at  I Si  (Vittal)  suggested  an  extension  to  the  iterative  statement  in  the  form  a 
RKrt'A twhii.h  and  R F 1*1- at  UN  ill.  operator.  I his  extension  was  of  general  value,  and  was 
implemented. 

A user  at  su-ai  (Davis)  found  a problem  with  the  translation  of  the  subset  operator.  The  bug  was 
eliminated. 

A user  at  Si'MFX  (l.ederberg)  eneountered  a problem  which  was  traced  to  the  faeility  for  musing 
the  structure  associated  with  large  numbers.  This  information  was  relayed  to  BBN  and  the 
problem  was  fixed. 

A user  at  SU-AI  (Davis)  found  a bug  in  the  history  facility  of  the  programmer's  assistant,  which 
was  fixed. 

A user  at  su-Al  (Gordon)  working  on  the  mathematical  semantics  of  advanced  MSP  systems 
requested  information  on  what  would  be  the  spaghetti-stack  primitives  in  IMFRI.ISP,  in  order  to 
determine  if  his  semantic  domains  were  adequate  for  representing  the  denotations  of 
environment  manipulating  operations.  We  supplied  him  with  a draft  form  o."  the  spaghetti  stack 
documentation  and  answered  some  additional  questions. 

A user  at  bbn  (Lewis)  found  a bug  relating  to  nested  171.  operators  in  t)Wi\i. 

In  response  to  a request  from  bbn  (Lewis),  the  iterative  statement  of  dwim/ci  isp  was  extended  to 
permit  the  user  to  specify  an  expression  which  computed  the  expansion  of  an  operator.  This 
significantly  increased  the  range  of  applications  of  the  iterative  statement,  and  enabled  a number 
of  projects  to  take  advantage  of  the  benefits  of  increased  clarity  of  code  that  the  iterative 
statement  provides. 

In  response  to  a request  from  BBN  (Bates),  we  provided  a description  of  a PARC  developed 
package  (Teitelman)  for  allowing  the  user  to  load  a large,  heavily  commented.  symbolic  program, 
without  actually  having  to  load,  and  pay  the  storage  costs  for  all  of  the  comments.  As  a result  of 
its  usefulness  to  the  BBN  project,  this  package  was  documented  and  included  in  the  INU  RUSP 
system. 

A user  at  SUMFX  (Van  Mellc)  requested  a wa;  of  disabling  certain  Cl  ISP  operators  with  respect  to 
<’l  ispipyinc;.  i.e.  converting  l isp  programs  to  t I isp.  while  leaving  active  the  inverse 
transformations  from  CI.ISP  to  I isp.  This  facility  did  not  exist,  and  so  was  added. 

A user  at  isi  (Hyland)  discovered  a flaw  in  I lie  I)\VIM  scheme  for  recover’,  following  an  error  in 
certain  situations.  UW'.M  was  revised  and  extended  to  cover  tins  case. 

In  response  to  several  requests,  a facility  developed  at  PARC  ( feitelman)  fo«  automatically 
maiking  those  poitions  of  a programs  listing  corresponding  to  change  was  made  a pot  of  the 
standard  inu  rmsp  system  and  released  to  the  arpa  community  at  large. 

A user  at  USC'-I  < I (Britt)  discovued  and  reported  a serious  problem  with  interrupt  characters, 
which  was  forwarded  to  BBN  and  repaired. 


A user  ai  ski  (Paxion)  discovered  a problem  with  the  user  interface  with  the  compiler,  which  was 
repaired  by  PARC. 

BBN  (Lewis)  requested  a way  of  augmenting  the  Fnglish-to-t ISI*  transformations  in  CUSP,  e.g.  to 
be  able  to  tell  cusp  that  a phrase  such  as  "x  is  the  beginning  op  an  array"  should  translate 
into  the  LISP  expression  (AND  (ARRAYP  X)  (ARRAYBFG  X)).  This  facility  was  added. 

ISI  (Yotike)  reported  that  the  greeting  facility  in  intfrusp  malfunctioned  when  the  number  of 
directories  in  the  host  tfnfx  was  increased  beyond  511.  This  was  repaired. 

SCI-TENHY  (Holsworth)  requested  a version  of  intfrusp.  We  supplied  same  and  helped  them 
with  the  necessary  initialization  procedures. 

PARC  (J  Moore)  discovered  a bug  in  the  compiler  relating  to  the  use  of  free  .jriables,  which  was 
reported  to  BBN  and  fixed. 

Charles  Vollum.  of  the  Oregon  Museum  of  Science  and  Industry,  contacted  PARC  about  an 
implementation  of  intfrusp  on  the  PDP-11  that  he  was  working  on.  We  sent  him  a copy  of  the 
VM  specification,  and  put  him  in  touch  with  the  people  at  BBN  who  were  interested  in  the  same 
project 

Mark  James,  of  the  University  of  California  at  Irvine,  contacted  PARC  about  implementations  of 
INIFRUSP  for  (lie  CDC  33(H),  and  for  lopsio,  which  lie  was  working  on.  We  gave  him  a 
complimentary  aceouni  at  PARC  so  that  lie  could  experiment  with  imi  Ri  a’,  and  interact  with  us 
via  the  message  facility  about  ideas  that  he  had,  and  problems  lie  encountered.  He  took 
advantage  of  this  invitation  and  the  PARC  facility  frequently. 

To  facilitate  the  expected  frequent  release  of  new  and  incompatible  versions  of  the  intfrusp-io 
compiler,  BBN  (Hartley)  requested  installation  of  a facility  for  automatically  detecting  when  a 
us*3:  attempted  to  load  a file  compiled  with  an  incompatible  (older  or  newer)  compiler. 

A user  at  sumex  (Van  Melle)  found  a subtle  but  potentially  serious  problem  with  the  translation 
of  iterative  statements  by  D\viM.  This  bug  was  fixed 

A user  at  PARC  (Teitelman)  encountered  and  isolated  several  bugs  relating  to  applications  in 
which  user  programs  performed  their  own  input  operations  directly,  instead  of  by  using  the 
INTFRUSP  rfad  program. 

A user  at  PARC  found  a bug  in  the  garbage  collector,  which  was  reported  to  bbn  and  fixed. 

Another  user  at  PARC  found  a bug  in  the^ compiler,  which  was  also  icported  to  BBN  and  fixed. 

Jaak  Urmi,  of  Uppsala  University  in  SweJcn.  who  is  implementing  an  in  it  ri  isp  for  the  IBM  370, 
visited  PARC  and  engaged  in  a length'  discussion  about  the  iniiriisp  Virtual  Machine  w i i h 
several  PARC  scientist*  (Bobrow.  DeuUcli.  Moore,  leitelman).  Hie  resub  was  a much  greater 
degree  of  agreement  between  his  implementation  on  iMi  RUsp  ;•>  it  is  currently  imnlemmied. 
Should  this  implementation  become  available  in  the  United  Slates,  transporting  existing 
INIFRUSP  programs  to  the  370  implementation  will  he  much  easier. 

At  the  suggestion  of  a BBN  user,  a facility  was  provided  whereby  the  user  could  release  (some  of) 
the  storage  required  for  facilities  that  he  did  not  use,  or  was  not  using  at  th<‘  time.  Previously, 
the  burden  was  on  the  user  to  know  just  ho*-'  to  recover  this  storage.  The  new  facility, 


gainspacf.  walked  the  user  through  a menu  of  options,  querying  him  about  each  facility  and 
allowing  him  to  select  which  to  discard  and  which  to  retain,  gainspacl  is  important  to  users 
developing  systems  with  very  large  data  bases. 

There  were  several  inquiries  about  intlrlisp  for  the  new  Die  Kl.-io.  We  acted  as  intermediary 
for  the  various  sites  involved.  There  was  also  continued  discussion  with  Mark  James,  University 
of  California,  Irvine,  about  an  imp'emenlaLon  of  INILRIISP  for  'TOPS-IO. 

A user  al  sri-ai  (Boyer)  found  some  problems  with  the  new  facility  for  user  defined  iterative 
operators,  which  was  then  repaired. 

A user  at  ski-ai  (Spit/en)  requested  information  about  an  intlrlisp  to  MACLISP  translator.  We 
helped  him  with  the  problem  of  making  this  transformation. 

A user  at  PARC  found  a hug  in  the  compiler  relating  to  compiling  of  non-local  GOTO's.  This  bug 
was  reported  to  urn,  and  fixed  in  about  a week.  At  that  point,  a user  at  SKI  encountered  the  same 
bug.  As  a result  of  a PARC  user  having  previously  encountered  the  same  bug,  we  were  able  to 
immediately  supply  the  sri  user  with  the  necessary  fix,  otherwise  he  would  have  had  to  wail.  The 
benefit  to  other  4RP4  sites  of  having  P4RC  continuously  exercising  IMTPRIISP  releases  is  an 
important  one.  it  drastically  reduces  the  number  of  bugs  encountered  by  other  arpa  users,  and 
therefore  reduces  the  disruption  to  their  work. 

A user  al  ISIR  (Greenfeld)  found  a bug  in  the  ASKUSLR  package  and  also  suggested  some 
improvements  and  extensions  which  were  implemented. 

We  had  several  interactions  several  limes  with  Mark  James,  University  of  California  al  Irvine, 
on  his  implementation  of  INTI  Rl  ISP  for  the  ci)C  3300,  to  insure  that  it  would  be  compatible 
with  INILKI  ISP-10. 

Following  HHN’s  release  of  a new  compiler  designed  to  produce  more  efficient  code,  several  subtle 
hugs  were  encountered  and  isolated  by  PARC  users. 

A user  at  ism  (Yonke)  reported  some  bugs  in  DWIM  which  were  fixed 

A user  al  st’Mi-N  (Van  Melle)  reported  a bug  in  PR  PHY  print  relating  to  the  new  facility  for 
optionally  keeping  the  text  of  comments  or.  files  when  the  source  for  the  program  was  loaded. 
( ibis  facility  had  been  included  in  the  INTFRUSP  system  at  runs,  request,  as  described  in  the 
previous  quarterly  management  report.) 

A user  at  c\1U-H)A  (Clark)  needed  some  help  in  reviving  some  old  versions  of  INTTRI  isp  in  order 
to  perform  some  measurements  on  some  old  sy souls.  We  provided  these  programs  from  our 
archives. 

A user  al  ISIR  (Greenfeld)  requested  assistance  in  converting  some  programs  from  MACLISP  to 
INILRIISP.  We  helped  him  in  this  project. 

We  provided  a user  at  RRN'  (R  Bobrow)  the  sources  for  a parsing  program  developed  al  PARC 
(Kaplan)  for  use  in  conjunction  with  the  intelligent  terminal  project.  We  also  provided  him  with 
assistance  on  the  use  of  the  parser,  and  made  some  changes  that  he  requested. 

Several  extensions  to  the  record  package  requested  by  users  at  ISI  were  provided,  including  a 
synonym  facility,  a way  of  computing  the  field  names  of  a given  record,  and  several  new'  record 
types.  Masterscope  was  extended  to  know  about  records. 


A user  at  ISIB  (Srinivasan)  was  experiencing  a great  deal  of  difficulty  getting  his  program  to  load 
into  a stripped  down  version  of  intfriisp  (it  was  too  large  to  load  into  the  full  iNtKRUSP).  We 
provided  him  with  assistance  and  suggestions  over  a period  of  a few  weeks  until  he  was 
successful. 

A user  at  sumex  (Stefik)  needed  a facility  which  would  make  a copy  of  any  interlisp  data 
structure,  including  structures  that  contained  user  defined  datatypes,  and  were  potentially 
circular  or  reentrant.  This  facility  was  provided  (Masinter). 

A user  at  SUMF.X  (Van  Melle)  found  a problem  with  the  ordering  of  tests  in  the  translation  of 
iterative  statements. 

A user  at  bona  (Harris)  suggested  an  improvement  to  the  algorithm  used  in  translating  F/L 
expressions.  This  improvement  was  implemented. 

A user  at  sri-ai  (Fikes)  requested  a way  of  selectively  turning  off  various  CUSP  operators  that 
was  currently  not  possible.  This  addition  was  performed. 


modifying  or  improving  existing  features ” 


During  the  contract  year,  there  were  a number  of  significant  extensions  or  additions  to 
INTER  lisp  contributed  by  PARC  scientists  under  Parc  supported  research.  While  these  do  not  fall 
directly  under  the  aegis  of  the  arpa  contract,  nevertheless  they  are  a logical  outgrowth  of  PARC's 
involvement  with  INTF.Ri.isp  and  the  arpa  community,  and  significantly  benefit  both. 

A fast  string  searching  algorithm  was  invented  by  Boyer  (SRI)  and  Moore  (PARC),  and 
implemented  in  inti  ri  isp  by  Moore.  The  new  procedure  was  generally  10  to  50  times  faster  than 
the  existing  routines  for  searching  for  strings  in  a file,  and  is  now  heavily  used  for  applications 
calling  for  extensive  file  searches,  e.g.  the  on-line  documentation  of  the  inhkiisp  system. 

An  extremely  general  user  interaction  package.  ASK  USER,  was  designed  and  implemented  at  PARC 
(Teilelman).  A single  call  to  askuslk  can  be  used  to  specify  the  protocol  for  an  entire  sequence 
of  interactions.  a\i  each  point,  ASKsrsi-R  can  prompt  the  user,  give  him  a list  of  acceptable 
responses,  or  allow  him  to  start  over.  For  example,  the  l ENFX  EXEC  interactions  with  the  user 
could  be  entirely  handled  with  a single  call  to  askusf:r. 

The  File  Package  was  extended  to  inform  the  user  when  functions,  records,  or  other  entities  were 
changed,  and  therefore  needed  to  be  written  out.  but  the  corresponding  ent’ty  was  not  associated 
with  any  particular  file.  This  situation  frequently  occurs  when  a user  is  in  the  early  stages  of 
developing  a system.  If  the  user  forgets  to  associate  the  new  entities  he  defines  with  a symbolic 
file,  they  would  not  be  dumped,  and  would  therefore  he  lost  when  the  user  reloaded  in  a new 
system.  The  extension  to  the  file  package  causes  the  user  to  he  reminded,  and  allows  him  to 
specify  interactively  and  conveniently  on  what  files  the  new  entities  are  to  be  placed. 

The  iterative  statement  construct  of  ciisp  was  extend  :d  to  permit  the  user  to  define  his  own 
iterative  operators.  Ihis  extension  enables  the  user  to  take  advantage  of  the  clarity  of  syntex 
provided  by  the  iterati/e  statement  in  expiessing  operations  not  built  into  the  iterative  statement. 
For  example,  the  user  could  define  AVI Raoi  as  an  operator  with  an  appropriate  initialization: 
FIRST  SUM  ii  N - a.  main  step-  mjm*mi\mwh>v.  n-n*i,  and  a fmih/ation  which  computed  the 
average:  FtNAHV  Rl  IUKN  mim/N.  He  could  then  write  iterative  statements  such  as  I or  X IN  Y 
average  x when  x c;t  o.  or  for  i from  i to  ?o  ayiraoi  o:  whin  (puMK.ne  d. 


A coroutine  and  generator  package  was  designed  and  implemented  (Bomow  and  Kaplan)  which 
greatly  simplified  the  use  of  the  new  spaghetti  stack  capability  in  inttri.isp.  SKI  (Pikes)  was 
invited  to  use  the  package  and  made  a number  of  valuable  suggestions.  bbn  (Lewis)  provided 
some  important  compile)  interfaces  m^ssary  for  efficiency.  Virtually  all  applications  involving 
switching  of  contexts  now  use  this  package,  eg.  me  arpa  Decision  Aids  Project  and  the  Speech 
Understanding  Project  (SKI)  depend  aeavily  on  it. 

An  already  existing  facility  was  extended  and  generalized  to  permit  programs  to  protect 
themselves  against  aborts,  such  that  any  undoable  changes  executed  by  the  program  would 
automatically  be  undone  if  the  user  typed  th1  abort  key  (PARC,  Teitelman) 

A Hashfile  package  was  designed  and  implemented  (Masinter)  for  creating  and  accessing  a large 
database  on  a file.  The  databases  addressed  by  this  package  are  much  larger  than  could  be  stored 
in  the  user  virtual  address  space.  The  Hashfile  package  provides  a symbol-table  facility  with  a 
large  capacity  with  a relatively  small  additional  cost  in  run-time  over  using  intf.rusp  atoms.  It 
was  subsequently  extended  (Kaplan)  to  enable  complete  list-processing  on  a file.  The  Hashfile 
package  is  now  heavily  used  by  the  nvdical  diagnosis  project  (MYCIN)  at  sumex,  as  well  as 
various  projects  at  BBN. 

The  design  and  implementation  of  Mnsterscope  (Masinter)  was  completed.  Masterscope  is  an 
interactive  program  for  analyzing  and  cross  referencing  user  programs.  It  contains  facilities  for 
analyzing  user  programs  to  determine  what  other  programs  are  called,  how  and  where  variables 
are  bound,  set.  or  referenced,  as  well  as  which  programs  use  particular  record  declarations. 
Mastet scope  is  able  to  analyze  definitions  directly  from  a file  as  well  as  in  core  definitions. 
Masterscope  is  interfaced  with  the  interlisp  editor  so  that  when  a program  is  edited, 
Masterscope  automatically  notes  that  it  needs  to  be  reanalyzed.  Masterscope  is  also  interfaced 
with  the  (NiERLisP  file  package,  so  that  in  the  case  that  the  source  code  for  a compiled  program 
has  not  been  loaded.  Masterscope  can  automatically  retrieve  it  and  analyze  it  on  the  file. 
Masterscope  was  provided  with  a flexible  L nglish-like  eomand  language,  so  that  the  user  can 
express  complex  operations  in  a straightforward  fashion,  e.g.  what  1-unctions  use.  X and  c all 
ANY  FUNCTION  I HAT  BINDS  \.  SHOW  WHERE  ANY  EUN(  I ION  USE'S  EOO  AS  A RECORD  IT l;LD,  etc.  A 
facility  for  automatically  checking  a set  of  block  declarations  for  consistency  as  well  as  typical 
errors,  using  heuristics  gathered  from  various  users,  was  incorporated  into  Masterscope.  This 
facility  has  turned  out  to  he  extremely  useful  for  working  with  large  systems  of  programs. 

The  programmers  assistant  was  extended  to  handle  reexecution  of  an  event  or  events  for  a 
specified  number  of  iterations,  or  while  a particular  condition  was  true,  e.g.  REDO  event  WHILE  X 
IS  LESS  THAN  10. 


"Maintaining  document  at  ion  for  IMPRUSP,  producing  new  documentation  where  necessary , said 
documentation  to  be  on  line , machine  readable 

We  revised,  updated,  and  totally  reformatted  the  interlisp  manual.  The  reformatting  was 
designed  to  take  advantage  of  the  multiple  foms  provided  by  our  in-house  printing  facility.  By 
use  of  sm  dler  fonts  for  footnotes,  as  well  as  going  to  single  space,  we  were  able  to  reduce  the 
size  of  the  manual  considerably,  whi’e  at  the  same  lime  improving  its  readability. 

The  entire  preparation  of  the  manual  was  automated  using  the  PUB  faci  ty.  Our  conventions 
were  embodied  in  special  PUB  macros  developed  for  the  purpose  of  insuring  consistency  of 
format,  both  for  aesthetic  reasons  as  well  as  to  enable  processing  of  the  text  by  III  I PSYS,  the 
on-line  doeumudaiion  system  simultaneously  being  developed  (see  below).  This  approach  also 
made  feasible  the  flagging  (with  a special  character  in  the  margin)  of  any  malerial  that  was 
changed  or  added.  I lius,  users  alieadv  familiar  with  the  IN  I EKi.l.sp  system  could  skim  the  new 
manual  and  quickly  see  what  was  different. 


The  new  manual  provided  documentation  for  a number  of  important  facilities  that  had  appeared 
since  the  publication  of  the  last  manual  in  October,  1974,  including:  the  spaghetti  stack 
capability,  the  coroutine  and  generator  package,  user  data  types,  Masterscope,  askuser,  user 
interrupt  characters.  The  new  manual  also  incorporated  a number  of  suggestions  made  by 
INTERLISP  users  for  making  the  manual  clearer  and  easier  to  use.  All  told  there  were  changes  to 
1.7*!  pages  (of  approximately  600  total  pages),  a testimonial  to  the  evolving  nature  of  the 
INTERI.isp  system.  7C»0  copies  were  printed  and  are  being  distributed. 


"-.(producing)  programs  for  convenient  accessing  of  this  manual , i.e.  an  information  retrieval  facility" 


We  iniflemented  Helpsys,  an  on-line  documentation  system  that  uses  the  interlisp  Reference 
Manual  as  a data  base.  Using  Helpsys.  the  user  can  ask  quesuons  about  topics  in  the  INTF.RUSP 
manual,  using  a constrained  hut  Fngli.-dHike  command  language,  eg.  "TELL  ME  ABOUT 
PRE -m  print."  "Wi  i a r are  THE  AR(ii  i.Mi  n I s lo  roM  pi  I H."  Where  there  are  several  subcategories 
of  the  indicated  subject,  Helpsys  will  allow  the  user  to  specify  more  precisely  what  it  is  he  wants 
to  know.  For  example,  if  the  user  asked  ill  i me  about  PROP.”  Helpsys  would  repond  "(1) 

Pretty  dot*  command,  (2)  reference  t>ped  by  editor,  (3)  error  message,  (4)  define  {cross 

referenced  subject},  Which  one?"  Helpsys  knows  about  descriptions  of  function  definitions, 
system  flags,  editor  commands,  break  commands,  etc.  as  well  as  general  topic  references,  e.g. 
" I FI. I ME  ABOU’I  MAKING  A SVMBOIIO  Ell  I,"  "I  Ell.  ME  ABOUT  COKOUIINRS  AND  GENERATORS." 

For  each  request,  Helpsys  presents  a specified  amount  of  text  (for  display  terminals,  one 

screenful).  I he  user  can  then  continue  to  browse  from  that  point  forward  or  backward  in  the 
manual,  or  give  a new  request.  When  given  an  unrecognized  topic.  Helpsys  performs  spelling 
correction  as  well  as  "wildcard"  completion.  For  example,  if  the  user  has  forgotten  the  name  of  a 
particular  flag  in  the  system,  but  knows  it  begins  with  (’MSP  and  ends  with  fig,  he  can  say: 
"TEN  Ml  ABOUT  ( I isPSEl.t »."  whereupon  llelpsvs  will  provide  him  with  a list  of  categories  which 
match  with  cuspsei.g. 

Ilelps>s  now  a part  of  the  standardly  released  iNH  Ril.sp  system,  and  the  Helpsys  database,  i.e. 
a special  formatted  representation  of  the  IMIKIISP  manual,  has  been  distributed  to  various 
arpa  silt.  . We  expect  that  llelpsvs  will  make  the  large  amount  of  information  contained  in  the 
INTI  Riisp  Manual  more  rcadil)  available  to  on-line  users. 


"Periodically  bring  up  and  checking  out  new  releases  of  the  system , and  distributing  them  to  selected 
ARPA  sites." 


During  the  only  part  of  the  contract  year,  a great  deal  of  activity  centered  around  shaking  down 
the  newly  released  (by  bun)  spaghetti  stack  system.  T he  spaghetti  stack  capability  had  been  under 
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and  switch  back  and  fe.ih  between  several  different  environments  simultaneously,  and  was 
absolutely  essential  for  many  of  the  advanced  application  systems,  such  as  command  and  control, 
now  being  developed.  As  is  usually  the  case  with  such  a major  chance  in  a large  system,  a great 
number  of  problems  were  encountered  by  users  at  part.  Frequently  these  problems  were  of  the 
nature  as  to  totally  destroy  the  program  that  was  being  run  when  they  were  encountered. 
Fortunately,  we  were  able  to  interact  quickly  with  bbn  implementors  via  the  arpa  not.  and  the 
problem  would  usually  be  fixed  within  a day  or  so.  At  that  point,  we  would  reload  the  system 
and  continue  trying  to  break  it.  During  some  phases  of  this  effort,  this  was  almost  a daily 
process:  during  the  first  quarter  alone,  B'aN  released  30  .lew  versions  of  t he  basic  system,  most  in 


response  to  problems  encountered  by  PARC  users.  This  process  required  much  patience  on  the 
part  of  the  users  at  PARC  who  were  the  guinea  pigs  for  this  experimental  system.  However,  as  a 
result  of  Parc  users  serving  this  function,  the  number  of  bugs  that  were  subsequently 
encountered  by  users  at  other  arpa  sites,  and  the  consequent  disruption  of  their  work,  were 
greatly  reduced.  Finally,  a fairly  stable  and  robust  system  emerged  and  was  released  to  the  ARPA 
community. 

In  addition  to  releasing  the  spaghetti  stack  system  to  arpa  sites,  we  produced  and  provided 
documentation  for  the  new  spaghetti  stack  system.  In  addition  to  providing  reference  material 
that  was  later  included  in  the  new  intkrusp  manual,  this  documentation  was  designed  to  aid 
users  in  making  the  conversion  from  the  pre-spaghetti  stack  system  to  the  new  system.  It 
contained  the  results  of  our  six  months  of  experience  with  trie  system:  what  things  to  look  for  in 
the  users  code,  how  to  rewrite  them,  pitfalls  to  avoid,  subtle  efficiency  issues,  etc.  In  addition  to 
the  doeumeniati  »n,  W Tei'elman  visited  SRI  and  isi  and  presented  seminars  on  the  new  system 
and  how  to  convert  to  !t. 

A principal  effort  during  the  latter  part  of  the  contract  year  involved  shaking  down  and 
checking  out  the  newly  released  (by  rcn)  version  of  the  basic  intkrusp  system  that  employed  a 
new  scheme  for  representing  the  values  of  variables  called  "shallow  binding." 

"Deep  binding,"  t scheme  employed  for  binding  variables  previously  in  the  intkri  ISP, 
involved  storing  th  name  and  value  of  the  variable  on  a stack.  Accessing  the  value  of  a variable, 
either  to  obtain  its  ■ aiue  or  to  assign  it  a new  value,  thus  involved  searching  up  the  stack  looking 
for  its  binding.  The  time  required  was  proportional  to  the  distance  on  the  stack  to  its  most 
recent  binding. 

With  shallow  binding,  a variable  is  bound  by  storing  its  value  in  a special  cell  associated  with 
the  variable  called  its  value  cell  rh*  current,  i.e.  old,  value  of  the  variable  is  then  stored  on  the 
stack.  Thus  accessing  a variable  requires  no  searching  at  all,  and  simply  involves  accessing  it.’ 
value  cell.  However,  binding  and  unht  uling  are  more  expensive  operations  than  under  the  deep 
binding  scheme.  Furthermo:  \ spagh.Tc  slack  operations,  i.e.  those  that  involve  switching 
contexts,  are  also  more  expensive.  However,  preliminary  measurements  undertaken  by  ihjn  and 
PARC  indicated  that  on  the  balance,  shallow  binding  would  be  more  efficient  than  deep  binding, 
since  a considerable  portion  of  th<‘  running  time  of  a typical  program  was  spent  in  looking  up 
free  variables.  Furtlp’rmore,  shallow  binding  had  the  benefit  that  programs  that  were  run 
interpretively.  as  is  usually  the  case  when  they  are  under  development,  would  run  much  faster 
than  with  deep  binding.  (Normally,  efficiency  arguments  are  considered  with  respect  to  the 
finished  product.  However,  this  overlooks  the  fact  a significant  portion  of  the  useage  of 
intkri  isp  is  in  developing  and  experimenting  with,  systems.  Unis,  improvements  in  the  running 
of  interpretive  programs  are  important.)  Shallow  binding  also  provided  the  benefit  that  large 
programs  would  not  require  the  esoteric  tuning  and  reconfiguring  to  obtain  maximal  efficiency 
that  they  currently  did  under  deep  binding. 

Converting  to  shallow  binding  required  an  intensive  amount  of  effort  by  bun  over  a period  of 
many  months.  The  first  shallow  binding  system  was  released  to  PARC  on  January  16.  At  that 
point,  we  began  converting  the  inii  riisp  library  to  conform  to  the  new  binding  scheme.  Some 
of  the  difficulties  that  we  bad  in  the  this  conversion  process  suggested  changes  which  would 
facilitate  the  conversion  process  for  less  experienced  users.  In  addition,  as  is  always  the  case  with 
so  basic  and  pervasive  a change  to  a large  system,  we  found  a number  of  serious  bugs  both  in  the 
basic  system  released  by  run  and  the  corresponding  compiler.  As  a result.  our  interactions  with 
BUN  over  the  network  wov  many  and  varied.  For  example,  during  one  three  day  period  in 
January,  137  messages  were  exchanged  between  PARC  and  RUN.  I ach  time  a bug  was  encountered, 
we  informed  URN  (via  the  message  facility).  When  a new  basic  s>stem  was  available  which 
repaired  this  particular  problem,  we  would  then  reload  and  continue  with  the  conversion  and 
check  out.  This  iteration  frequently  operated  on  a daily  basis.  For  example,  from  January  16 


when  the  shallow  binding  s\ stem  was  first  released,  through  the  end  of  the  quarter.  RUN  released 
34  different  versions  of  the  basic  ivilKliM*  system,  and  1?  veisions  of  the  compiler,  h.ach  new 
version  required  reloading  the  entire  INURIISI*  system.  In  addition,  some  hugs  required 
completely  recompiling  the  inu-ri  isp  library.  As  a result,  enormous  quantities  or  itu  time  were 
expended.  For  example,  in  January  alone,  we  used  thirty  eight  hours  of  <Tti  time  in  this  process, 
almost  twice  as  much  as  the  next  biggest  user  at  PARC.  (Actually,  this  computer  time  w;n  donated, 
since  arpa  does  not  pay  for  the  computer  time  used  under  this  contract)  When  we  finally  were 
successful  in  converting  the  entire  jnu  kjisi*  system  and  getting  it  to  run.  the  in  experimental 
system  was  released  to  users  here  at  pari’,  and  they  in  turn  began  finding  more  hugs. 

Meanwhile,  we  were  dismayed  by  our  initial  timings  on  the  new  system.  At  first,  programs  ran 
slower  in  the  new  shallow  binding  system  than  under  deep  binding.  A lengthy  sequence  of 
interactions  with  bbn  during  which  we  timed  and  made  adjustments  and  timed  some  more 
finally  led  to  discovery  of  the  critical  elements  in  the  system,  and  in  producing  a ve  sion  of  the 
shallow  binding  system  which  achieved  our  expectations.  It  would  he  an  understatement  to 
observe  that  the  checkout  and  tuning  of  the  shallow  binding  system  would  have  been  extremely 
difficult,  and  taken  much  longer,  had  we  not  been  able  to  interact  with  RUN  rapidly,  as  was 
possible  via  the  arpa  network. 


" Insuring  that  new  implcmcntions  of  l,\ri:iU  ISP  conform  to  tSTERUSP  standards." 


In  order  to  provide  some  uniformity  for  the  various  implcmcntions  of  inii  riisp  planned  or 
under  developement,  we  decided  to  try  to  define  and  set  down  on  paper  the  specifications  for 
an  IN'!  HU  hi*  Virtual  Machine.  The  virtual  machine  (or  simply  v\i)  is  the  underlying  list*  system 
on  top  of  which  is  built  the  large  and  sophisticated  collection  of  user  support  facilities  which 
make  up  the  bulk  of  IMI  Rl  tsp  (such  as  nwixi,  the  programmer’s  assistant,  etc.).  Thus,  if  vxi  usp 
is  implemented  on  some  machine,  the  rest  of  imiriisp  can  be  obtained  from  publicly  available 
files  and  simply  loaded  and  run.  flic  document  which  prepared  is  essentially  an 
implementor’s  specification  of  vst  I isp  for  iniiriisp.  It  makes  explicit  (for  the  first  time 
any  vs  here)  exactly  vvliat  an  implementor  has  to  provide  in  order  to  satisfy  the  assumptions  of  the 
large  collection  of  iniiriisp  programs  in  existence.  For  example.  iMiklisi*  assumes  the 
existence  of  entities  called  atoms.  Associated  with  each  atom  is  a datum  called  its  value  cell. 
Values  are  obtained  via  the  function  (HMopvaI.  and  set  via  the  function  srilOPVM.  The 
implementor  is  free  to  represent  atoms  in  any  t urn  that  he  chooses,  so  long  .is  he  provides 
the  functions  c.f-TIOPVAt  and  Shl’IOPVAi  to  interface  the  user’s  programs  with  Ins  particular 
implementation. 


The  vm  project  produced  an  implementation-independent  set  of  primitives  for  performing  basic 
operations  such  as  input/outpul.  manipulating  the  stack,  generating  and  handling  errors,  etc.  As 
the  project  progressed,  v.e  interacted  increasingly  with  bbn.  who  was  responsible  for  maintaining 
that  part  of  in i i ri  isp-in  which  corresponded  to  the  VM.  We  tried  to  reach  agreement  with  RUN 
on  anything  in  the  VM  specification  that  would  require  a change  to  the  IN  1 1 Rl  isp-to 


im  pic 


iation.  because  RUN  would  have  to  make  that  change.  We  felt  that  any  primitives 


defined  in  the  VM  must  be  provided  in  the  vm  implementation  for  tsit  RMM’-m,  the  most  widely 
used  implementation,  or  che  the  vm  .specification  would  just  be  an  academic  exercise.  Ibis 
constraint  injected  a much  needed  pragmatic  note  into  the  effort. 


Wherever  we  found  implementation  dependent  primitives,  and  reached  agreement  with  run  on 
how  to  express  and  provide  ihcse  primitives  in  an  implementation  independent  manner,  we 
converted  the  corresponding  INURiisi*  programs  to  use  the  new  primitives.  It  turned  out  that 
many  INURiisi’  programs,  including  a large  portion  of  the  imikiini*  system  itself,  contained 
many  hidden  assumptions  about  the  implementation,  in  this  ease  IN  it  Rl  ist’-to  on  Tcnex.  To  this 


extent,  they  were  machine  dependent,  and  might  not  run  on  (or  at  least  require  some  converting 
to  run  on)  some  of  the  implementations  of  INIIRMSR  for  other  machines  that  were  currently  in 
progress  (not  to  mention  the  fact  that  the  implementors  had  no  precise  guide  of  what  w is 
expected  of  their  implementations.)  As  a result  of  the  v\i  project,  most  of  the  intkrlisp  system 
is  now  written  in  terms  of  implementation  independent  primitives  described  in  the  Virtual 
Machine  Specification.  Some  parts  of  the  in  I e K l lsiJ  system  remained  implementation  dependent, 
such  as  those  programs  which  provided  direct  access  to  Tenex  capabilities  which  were  not 
specified  m the  VM  because  they  might  not  be  available  in  other  implem; m.uiions.  I hese 
programs  were  separated  out  and  pul  in  different  files.  Thus,  at  the  end  of  the  project,  we  had  a 
set  of  source  files  describing  the  bulk  of  the  inm-.kmsp  system  in  an  implementation  independent 
manner. 

This  claim  was  then  successfully  put  to  a test  by  a project  underway  at  l»AKt'  to  implement 
inti  ri  isi*  on  a Xerox  mini-computer.  If  our  supposedly  implementation  independent  code 
could  in  fact  be  transported  from  the  i*t)l*-lo  to  this  mini-computer  and  would  in  fact  run,  we 
would  have  some  evidence  that  these  programs  were  machine  independent,  and  that  the 
specifications  in  the  \ M were  sufficient  to  guarantee*  transportability.  We  were  in  fact  able  to 
perform  tins  exercise.  While  this  implementation  of  iniiriisi*  is  not  itself  an  \RrV\  project,  the 
results  of  these  efforts  will  greatly  benefit  bbn\  implementation  of  iniiriisi*  f or  the  i’l)i*-ll, 
which  is  an  a r i*a  project. 

The  Interlisp  Virtual  Machine  Specification  Document  is  included  (under  separate  cover)  as  part 
of  this  final  report. 


